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© Control apparatus for electronic equipment 

@ An instruction of operation mode control of a 
VTR 40 and information on the video recording 
reservation is voice Inputted. The voice input is 
recognized by a voice recognition circuit 13 and 
is fed to a control circuit 15. The control circuit 
15 controls the VTR 40 in response to the 
instruction or information of the voice input and 
causes an animation character generating cir- 
cuit 16 to generate a video image of an ani- 
mation character AC for displaying it on the 
screen of a CRT display 30. A message of the 
animation character AC is voice synthesized in 
a voice synthesizing circuit 19 so that the syn- 
thesized voice is outputted from a speaker 20. 

The electronic equipment can be operated as 
if an user were talking with the animation 
character. A natural man-machine interface can 
be realized. 
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Fig. 1 is a block diagram showing the schematic structure of an embodiment of a control apparatus of the 
present invention; 

Fig. 2 is a flow chart showing a main operation of the control apparatus of the present invention; 
Fig. 3 is a schematic view showing a CRT screen on which an animation character and a balloon in an 
5 initial state are displayed; 

Fig. 4 is a block diagram showing a structure of a voice recognition circuit; 
Fig. 5 is a block diagram explaining the function of a control circuit; 

Fig. 6 is a flow chart showing the detail of the processing at each step in the flow chart of Fig. 2; 
Fig. 7 is a flow chart showing the detail of the reservation processing in the flow chart of Fig. 6; 
w Fig. 8 is an illustration showing the CRT screen on which a reservation input request is displayed; 

Fig. 9 is an illustration showing the CRT screen on which reserved information confirmation is displayed; 
Fig. 10 is flow chart showing the detail of an elementary information input and an elementary information 
input processing in the flow chart of Fig. 7; 

Fig. 1 1 is a flow chart showing the detail of a lacking information processing in the flow chart of Fig. 7; 
15 Fig. 12 is a flow chart showing the detail of a duplication check processing in the flow chart of Fig. 7; 
Fig. 13 is a flow chart showing the detail of a display processing in the flow chart in Fig. 6; 
Fig. 14 is a flow chart following the flow chart of Fig. 13; 

Fig. 15 is a flow chart showing the detail of a change processing in the flow chart of Fig. 6; 

Fig. 16 is a flow chart showing the detail of a cancel processing in the flow chart of Fig. 6; 
20 Fig. 17 is a flow chart showing the detail of a VTR operation processing in the flow chart of Fig. 6; and 

Fig. 18 is a flow chart showing the detail of an idling animation processing in the flow chart of Fig. 6. 

Now, the preferred embodiments of the present invention will be described with reference to the drawings. 

A control apparatus for electronic equipment of the present embodiment is a control apparatus for electronic 
equipment for controlling the selection of the operation mode of electronic equipment such as video tape recor- 
ds der (VTR) 40 as shown in Fig. 1. In the present embodiment, the VTR 40 is used as the electronic equipment. 
The present embodiment will be described with reference to controls such as the selection control of various 
operation modes of the VTR 40 such as recording, playback, fast feeding and rewinding and recording reser- 
vation. 

In the apparatus of the present embodiment of Fig. 1, a handset 1 0 which is similar to the telephone handset 

30 is provided as voice input means for inputting instructions for selection control of operation modes and various 
items of information by voices. A transmitter unit 1 1 of the handset 10 is provided with an acoustic-electrical * 
conversion element for converting an input voice into an electrical signal and outputting it. A press-to-talk switch 
12 for dividing inputs by switching the voice input mode is provided in the vicinity of the transmitter unit 11. An 
output signal from the transmitter unit 1 1 of the handset 10 is fed to a voice recognition circuit 13 in which it is X 

35 signal processed for recognizing the instruction and various items of information. An output signal from the ? 
switch 1 2 is fed to a switch state detecting unit 14 for detecting the on/off state of the switch. The voice recog- 
nition circuit 13 and the switch state detecting unit 14 are connected with a control circuit 15. With the control 
circuit 15 are connected an animation character generating circuit 16 for outputting a video signal of an ani- 
mation character which will become a message speaker, a voice synthesizing circuit 19 for synthesizing the 

40 voice signal of the message in response to a message signal input by using a technique of ruled voice synth- 
esizing, and a VTR controller 1 8 for controlling the selection of the operation mode of the VTR 40. A video signal 
from the character generator 16 is fed to a superimposer 17 in which it is superimpose upon the video signal 
from the VTR 40 and then the superimposed signal is fed to a cathode ray tube (CRT) display 30. A voice signal 
from the voice synthesizing circuit 19 is fed to a speaker 20 in which it is converted into a sound. The speaker 

45 20 and the CRT display 30 may be formed into an integral television receiver circuit. 

The control circuit 15 outputs at least an operation mode selection control signal which controls the selec- 
tion of the operation mode of the VTR 40 in response to an output signal from the voice recognition circuit 13, 
an action control signal for controlling the action of the animation character AC of the animation character 
generating circuit 16, an message signal for instructing a message voice which is desired to be synthesized in 

so the voice synthesizing circuit 1 9 and comprises a CPU such as a microprocessor. The control circuit 1 5 selects 
and outputs one control instruction which is appropriate for the current operation state of the VTR 40 from 
plurality of control instructions in response to an instruction for the selection control of the operation mode rec- 
ognized by the voice recognition circuit 13. The selection processing and the operation mode of the VTR 40 
will be described hereafter in detail. The control circuit 1 5 outputs a message signal instructing a message which 

55 is optimal as the content of a response in response to an voice input content (and further in response to the 
current state) and feeds the output message signal to the animation character generating circuit 16 and the 
voice generating circuit 19. 

In Fig. 1 , the transmitter unit of the handset 1 0 converts a voice pronounced by a man such as an operator 
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operating the VTR 40, that is, an user) into an electrical voice signal. The voice pronounced by the operator 
includes pronounced instruction words, such as "playback", •Tstop", "record", "pause", "slow", "fast-feeding" 
/Znf . , 3 h pro " 0 "" ced J" 0 * 8 such ^ the day of the week (Sunday, to Monday), every day, every week.' 
channel (channels to 12). starting/ending time (morning, afternoon, 0 to 12 o'clock) for making a reservation 
of video recording. In the present embodiment, the other words "Hey". "O.K.". "No" than the above mentioned 
words can be inputted as voices. :!. 

- The press^talk^wlteh U lbrtesignating the voice input state disposed in the handseMO instructs the 
dmsion of words pronounced by the operator by turning on or off. by the operator. In other words, the press- 
Ill T 1 f P K° V ' ded 10 dividS a " input VOiCe Si9nal 0f a sentence ""^Prising a plural continuous discrete 
Zl^Ll »°^°^ Sed by V0iC6 rec °9 nition in *• voice recognizing circuit 13. An output from the 
pje^to-talk sw, ch 12.s fed to the switch state detecting unit 14 which is provided in parallel with the voice 
recognrt.on cirou, 13. The sw.tch state detecting unit 14 generates a state instruction signal instructing the cur- 
rent on/off state in response to an output signal from a press-to-talk switch 12. The state instruction sianal 
assumes states "0" and "1 - when me press-tc-talk switch 12 is inoperative and operate l^JZ 
Accordingly, if voice recognition is desired to be conducted, the oress-to-ta|k switch 1? i« tum-n «J i u - 
off after completion of voice input. The voice recognition in processing units is thus performed in7esponse to 
J! . m. " 9 ^ nstmction si 9" al - Accordingly, it will suffice for the voice recognition circuit 13 not to 
^fH!^^ le, H 0, ' ^ fa^pteted ftom±he turning off (state "O-T) representabve for the completion 
of the vo.ce wo d input when continuous word inputting is performed by voice. In other words, the voice rec- 
225 * • ^detemiine clear starting and completion time when the voice is recognized. The range 
in which the voice can be recognized can be easily determined by a software so that it will need not to perform 
an unnecessary voice recognition processing for the noises outside this range. Since control of the handset 
10 is not performed, noises on switching of voice input (on cutting off of voices) will not be inputted 
Asensetfre^ 

output signal from the voice synthesizing circuit 19 to the receiver unit of the handset 10 and performing I input 
and output of voice via the handset 10 which is similar in shape to the telephone handset and malfunction on 
use at a noisy place can be prevented. Responded voice can be shielded from co-receiving listeners by feeding 
Uie responded voice signal to only the receiver unit of the handset 10 without feeding responded voice to the 

Sr h fn!^ h r t T 8 ! 6r ! 0reCeiVer - Vid6 ° reCOrding reservation Presetting operation and VTR operation 
can be performed without interfering the other co-receiving listeners. 

A flow chart of main operations in the apparatus of the present embodiment is shown in Fig 2 In Fia 2 
an animation character is called in initial state after the power to the apparatus has been turned on by carrying 
out the voice input or the other input operation at step S1 by.an operator (user), the animation charecterAC 

b! 2^ 9 ■ ' S ? K y \ d °" 3 SCree " SC ° f thS CRT display 30 and the apparatus is brou 9"* '"to a stand- 
by state of a voice input by the operator. That is. the animation character AC and a balloon SP for character 
djsplaying the content spoken by the animation character are superimposed upon the video signal from the 
VTR 40. a background video image and displayed. A message same as the message in the balloon SP (for 
example, a message "What can I help you?" representing the stand-by state) is synthesized in the voice synth- 
esizing circuit 19 simultaneously with the display of the message on the screen SC and the voice (for example 

™„^I k P V( ZV ia 9enerated from me speaker 20 - A calling processing at the step S1 is specifically 
exemplanly shown. When the name of the animation character AC (for example. Ivy) is called or a call "Hei" is 
made, or the power of the VTR 40 is turned, the animation character AC is displayed together with a message 
nres, here is Ivy. More natural atmosphere of dialogue is obtained by subsequently shifting to the state of Fig. 

The operator (user) voice inputs an instruction and various items of information for the selection control of 
Uie operation mode at step S2. If the insfruction is an instruction to activate the system for running the VTR 

mJ^f^T™ In P ^ e6dS i° St6P S3> ' he apparatUS is br0U9ht into a phase to direct| y c ° ntr °' operation 
mode of the VTR 40. If the insfrucbon is to reserve the video recording, the apparatus is brought into a mode 

^rfZT e T 9 ZT"!" 40. if iha instruction is to confirm the reservation, the program step 

will proceed to a step S5 in which the apparatus is brought into a mode to confirm the reserved.content. In the 
mode to confirm the reservation, the program step will proceed to the step 6 subsequently of the step 5 in which 
processing to change or cancel the reservation is made. In the modes to reserve the video recording and to 
confirm the reservation more sophisticated conversation between the operator and the animation character 

ACiscamedoutaswillbedescribed.AftercompletionofprocessingatstepsS3,S4andS5(S6) theapoaratus 
is returned into the stand-by state of a voice input i ' apparatus 

In an example of display in Fig. 3, the animation character AC is displayed in the left and lower area on 
SC. ,t will become a visual obstacle to a video image (background video image BG) displayed on the screen. 
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An animation character AC displayed in the lower and left of the screen will not become ah obstacle for the 
image on the screen. A character is displayed in the lower area of the screen SC, the legs of the character AC 
will not be levitated so that it will give a stable feeling. If the character AC is displayed on the lower and left 
side of the screen SC, a sense of incompatibility is less from the feeling of human being. The balloon SP to 
5 character display a message in the screen SC is displayed in the lower and right areas of the screen SC if the 
characters of the message are an array in a horizontal direction from the left to right and in a vertical direction 
from the upper to lower side, respectively. This will scarcely obstruct the image (background video image BG) 
on the screen SC. 

An animation action control signal is fed to the animation character generating circuit 16 from the control 

10 circuit 15 so that the action of the animation character AC is controlled. The animation character generating 
circuit 16 which receives the action control signal from the control circuit 15 outputs to the superimposer 17 a 
video signal which causes the animation character AC as shown in Fig. 3 which is a speaker talking with the 
operator to move his or her mouth in response to the voice output of the message. The animation signal includes 
a signal of a balloon SP for character displaying the message. The superimposer 17 superimposes the video 

15 image of the animation character AC upon the reproduced video image from VTR 40 and feeds it to the CRT 
display 30. The animation character AC displayed on the screen of the CRT display 30 is made a personified 
expressive character having familiarity. This causes the operator (user) to have a feeling as rf he or she were 
talking with the animation character (or electronic equipment). 

The voice recognition circuit 13 in Fig. 1 recognizes the above mentioned instructions and various items 

20 of information by processing the supplied voice signal and may be various in structure. A voice recognition cir- 
cuit having a structure as shown in Fig. 4 will be described. ■-. > 

In Fig. 4, an output signal (input voice signal) from the transmitter unit 11 of the handset 10 is supplied to 
the input terminal 21 and the input voice signal is fed to an operational processor 23 via an analog interface 
22. After the analog interface 22 changes the input voice level to a given level depending upon a control data 

25 supplied from a system controller 24 and then converts the voice signal into serial digital voice signals and feeds 
them to the operational processor 23. The operational processor 23 forms a voice pattern by frequency analyz- 
ing the inputted digital voice signals and corrects (time axis normalizes) the time distortion of the voice pattern 
due to changes in speaking speed of human voice and compares the time axis normalized voice pattern with 
a plurality of standard patterns preliminarily stored in a standard pattern storing memory 25 for conducting a 

30 so-called pattern matching processing. The pattern matching processing is to calculate the distances between 
the detected voice pattern and each of the standard patterns and to determine a standard pattern which has 
the shortest distance from the detected voice pattern. The result of processing is fed to the control circuit 15 
including the CPUs via the interface 26. A plurality of patterns of the above mentioned words of instructions 
such as "playback", "stop" and various items of information such as "Sunday", "channel 1" are stored in the 

35 standard pattern storing memory 23. The operational processor 23 recognizes the words by determining which 
the voice pattern of the input voice signal is of the plurality stored patterns (to whicrvthe voice pattern of the 
input voice signal is the nearest). Although the plurality of standard voice patterns may be stored in the standard 
pattern storing memory 25 by a manufacturer, or alternatively prior to starting to use the apparatus, these "pat- 
terns may be stored in the memory 25 by successively voice inputting the words by an operator and by fre- 

40 quency analyzing the input voice by the operational processor 23 to form the voice patterns. . . 

The output signal from the voice recognition circuit 13 is fed to the control circuit in which it is subjected to 
a natural language input processing or inference dialogue processing. 

An natural language input processing production system 32 functions in response to a voice input 31 from 
the user to form a meaning frame 33 depending upon the number of the reserved programs. The meaning frame 

45 33 is fed to the inference dialogue production system 34 to preset and control a video recording reserving 
scheduler 35. The natural language input processing production system 32 can be divided into a sentence nor- 
malizing production system PS1, dividing production system PS2, a language extracting production system 
PS3, and meaning understanding production system PS4. The inference dialogue production system 34 can 
be divided into an interpolation inference production system PS5, a custom learning production system PS6 

50 and a dialogue processing production system PS7. Slots of a plurality of items such as an item of information 
on the day of the week, an item of information on channel, an item of information on starting time, an item of 
information on recording period of time or ending time are provided as video recording reserving information 
in one meaning frame 33. Various items of information which have been voice inputted in the reservation pro- 
cessing are written into corresponding item slots. 

55 Fig. 6 is a flow chart explaining the processing at each step in the flow chart in Fig. 2. A case in which the 

video recording reservation and operation of the running system of the VTR 40 is shown. 

That is, an operation to call the animation character AC at step S1 in Fig. 2 is carried out at step S11 in 
Fig. 2. The call at step S11 is made in response to an voice input of calling instruction "IVY" or "Hey" or the 
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T* 9 nTnT t T*l L-VT* 40 38 d6SCribed 3t Step S1 in Fi9 - 2 - When a <*" for the ani ™«°" character 
AC .s inputted at the atop 31 1 . the program step will proceed to next stepi>12 and the animation character AC 

as shown .n Fig. 3 lS displayed on the screen SC of the CRJ.display 30 (activation of the animation character 
■ '■ "V: ' r.,. 

Determination whether the press-to-talk switch 12 is turned on or off is made at step S13. If the switch is 
turned off the program step will proceed to step S15. When an instruction from the operator is voice inputted 
' ;*^^ rt ^ w rtte ^ ^«n^'»'*an instactfen-to reserve the video,recording is made at 
step S16 If the instruction is an instruction to reserve the video recording (Yes), the processing of reservation 
of the video recording is carried out at step S17 and then the program step will return to step 818 If No (the 
Input 'nstruction Is not to reserve the video recording) at step S16;;the*rogram step wilLproceed to step S18 
at which determination whether or not the input instruction is an instruction to display the cbntent.of the video 
recording reservation which has been already earned out is made! If Yes at step S18, processing to display 
the previous content of video recording reservation on the screen SC of the CRT display .30 is. carried out at 

STsl there f er I™ 9 *" 11 Step Wi " retUm to step S15 - ,fiNb; the Prasram-step will proceed to 

step 20. Determinabon whether or not the inout inatnmHAn fr 0 m *h* : 

,jj„ ., .. ■ ■• - - in an mouuCuOii tu.cnanqe cne 

v deo recording reservation is made at step 20. If Yes at step S20, the video recording reservation is changed 
at step S21 and toen the program step will return to step S15. If No, the program step will. proceed to step S22 
Oetermtoaton whether a not the input instruction Js an instruction tocancel. toe video.recording reservation is 
made at step S22. If Yes, processing to cancel the video recording reservation is made at step S23 and the 
program step will return to step S15. If No, the program step will preceedto step S24: Determination whether 
or not the input instruction is an instruction to operate the animation character AC is made at step S24 If Yes 
the program step will return to the step S15 afterthe animation character AC is operated: The operation of the 
animation character specifically includes deletion of the animation character AC on the screen SC and cancel- 

It T *° ^ 40 iS madS 3t SteP S26 - ,f YeS ' processin 9 to °P erate *• VTR 40 is carried 
out at step S15. If no, processing is terminated. ." 

If there has been no voice instruction input from the operator within a given period of time at step S14 an 
appearance in which the animation character AC does not know what to do with himself is displayed Specifi- 
cally, actions in which the animation character AC firstly yawns and then leans upon theleft end of the screen 
or scratch himself on his own head are made. If there has been no voice instruction input subsequently an 
action in which the animation character AC lies Is made. Processing for. this, action will be hereafter referred to 
as processing for idling action. . : :f r , , 

Fig. 7 is a flow chart explaining the details of the reserving; processihgat step S17 of Fig. 6. That is in Fio 
7 a reservation input request representative of waiting for. Information; pn^the video recording reservation is 
displayed at step S50. The animation character AC and a character message "Please, make a reservation- in 
the balloon are displayed on the screen SC of the CRT display 30. At this time, a synthesized voice "Please 
make a reservation" is pronounced and simultaneously with this, a moving picture in which the mouth of the 
animabon character AC moves is displayed. In an example of Fig, 8 ; characters "reservation" representing the 
current mode are displayed in a character display window PWJn. the right andupper position of the screen SC 
Voice input of various items of information such as the day of the week, channel, starting and ending time 
to make a reservation of the video recording of the VTR 40 is performed.at next step ..861 in Fig. 7 while the 
display as shown in Fig. 8 (and voice output) is carried out: A plurality of items of information can, be inputted 
in desired order once at the step S51. Accordingly, input processing relying upon the natural language input 
processmg production system 32 as shown in Fig. 5 is carried out at step s51. After each processing of nor- 
mataation and division of a sentence, word extracting and meaning understanding has been performed, a 
plurality of items of information are classified into corresponding slots of items.of the meaning frame 33 such 
as an item of information on the day of the week, an item of information on starting time.an item of information 
on the recording period of time or ending time. „■:..•;?•. m;. :~< : . —.>, v •.-.r, 

After parforming the infoimation input processing at the S52; determination whether or not there is any 
insufficiency of elemental information is made step S53. MU p<occ* -i to a wf. • -i -VcVr^ >• 

Words -insufficiency of information' means that an items oT^nfonnation are not provided in toe,^ 
boned meaning frame. When four items of information such as.the day of the week, thexhannel, the starting 
time and the ending time (or the recording period of time) are provided^ the meaning frame preservation 
of video recording, a normal video recording reservation cannot.be earned out if one of. (bur items is lacking 

If it is determined that the elemental information is lacking (Yes) at step S53, an inquiry on the lacking ele- 
T,h ' nf ° rm ^ t ' on ^ ma de at step S66 and the program step will return to step S51 . Cbmplefhenfary processing 
ofthe lacking information will be described hereafter with reference to Fig: 11. , i < ' , 

If it is determined at step S53 in Fig. 7 that there is no lack of. information (No), the program step will proceed 
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to the step S54 at which each inputted elementary information is confirmed. A display as shown in Fig. 9 is 
made on the screen SC of the CRT display 30 on confirmation of the elemental information at step S54. The 
animation character AC and a character message "Is it OK?" in the balloon SP are displayed as is similarly to 
the case of Fig. 8 and synthesized voice "Is it OK?" is pronounced simultaneously with the mouth of the ani- 

5 mation character AC. Characters "Reservation 0 representing the current phase is displayed in the character 
display window H on the screen SC. As the confirmation display of Fig. 9, a window PR for displaying video 
recording reservation contents is provided in the center of the screen SC. Each item of data in the meaning 
frame such as data on the date and the day of the week Tuesday, Nov. 7th " the data on the starting and ending 
times "3 a.m. to 4 a.m." and the data on the channel "channel 6" are displayed in the display window PR. 

10 Voice input for confirming the reservation at step 54 is carried out at next step S55 in Fig. 7 while such a 

display of Fig. 9 is conducted. Voice input of instructions such as "Yes", "Return", "No" and "Change" or the 
elementary information is carried out. It is of course that the natural language input processing as shown in 
Fig. 5 is also conducted at this time. Determination whether or not the voice input at step S55 is "Yes" is made 
at step S56. If it is determined "Yes" (voice "Yes" is inputted), the program step will proceed to step S67 at 

15 which it is checked whether or not video recording reservation is duplicated. If it is determined Yes at step S56 
(other than "Yes"), program step will proceed to step S57. At step S57, determination whether voice input at 
step S55 is "Return" is made at the step S57. If it is determined at step S68 "Yes", determination whether or 
not an inquiry on lack of the elementary information is made. If Yes or No at step S68, the program step will 
return to steps S68 or S50, respectively, tf the determination at the step S57 is No, the program step will proceed 

20 to the step S58. Determination whether or not voice input at the step S55 is elementary information is made at 
the step S58. If the voice input is elementary information (Yes), the program step will return to the step S52. If 
the voice input is a voice input other than the elementary information (No), the program step will proceed to 
the step S59. Determination whether or not the voice input at step S55 is "Change" is made at step S59. If No, 
the program step will proceed to step S60. Selection whether each item of elementary information of the video 

25 recording reservation is changed or canceled is made at step S60. Accordingly, any input of change/cancel is 
carried out at step S61 and the program step will proceed to step S62. Determination whether or not the voice 
input is "change" is made again at step S62. If No, the video recording reservation is stopped at step S69. If 
Yes at step S62, the program step will proceed to step S63 at which the content of change is inquired. After 
elementary information is inputted again at step S65, the program step will return to step S52. 

30 Fig. 10 is a flow chart showing the detail of the elementary information input at step S51 of Fig. 7 and the 

elementary information input processing at step S52. 

Fig. 10 shows the flow of action in consideration of that the natural language "Return" has a plurality of 
meanings and different controls are necessary depending upon the current condition. In other words, if elemen- 
tary information is inputted in Fig. 10, the meaning of the inputted elementary information is analyzed at step 

35 S71 and the program step will proceed to step S72. Determination whether or not the inputted voice is "Return" 
is made at step S72. If Yes, the program will proceed to step S73. Determination whether or not the just previous 
inputted voice is "Return" is made at step S73. If Yes at step S73, the program step will proceed to step S75 
at which processing to stop the reservation is performed and then the processing is terminated. If it is deter- 
mined No at step S73, the program step will proceed to step S74 at which determination whether or not there 

40 is any question immediately before is made. If No at step S74, the program step will proceed to step S75 at 
which the reservation is stopped. If Yes, the program step will proceed to step S76. At step S76, an inquiry just 
before is made and the program step will return to the elementary information input step of step S51 of Fig. 7. 
If it is determined No at step S72, the program step will proceed to step S77. Determination whether or not 
there is any error is made at step S77. If Yes, the program step will proceed to step S79 at which error item is 

45 inquired. Then the program step will return to step S51 at which elementary information is inputted. If it is deter- 
mined No at steps 77, the program step will proceed to step S78 at which writing into the meaning frame is 
performed and then the processing is terminated. 

If a word which has a plurality of meanings like "Cancel" or "OK" other than "Return" is voice inputted, a 
natural language processing program is incorporated so that the meaning of the inputted word can be correctly 

50 interpreted depending upon circumstance to perform processing, that is, to enable to process the diverse mean- 
ings of a word. This can be achieved by incorporating the current condition into the object of determination as 
shown in Fig. 10. This enables the operator to operate the apparatus by the natural language which is used in 
ordinary life of human being. 

The voice input "Return" or "Cancel" has various meanings also in a phase in which the feeding system 

55 of the VTR 40 is directly operated at step S3 of Fig. 2 or the phase of reservation confirmation at step S5 (and 
S6). A response which is appropriate dependin upon the circumstance is taken depending upon the circumst- 
ance. This will be described hereafter. 

Fig. 1 1 is a flow chart showing the detail of the processing of the lacking information in Fig. 7. Fig. 7 shows 
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starting time is the same as the ending time. Please input the time again " which points out the error item of 
the inputted sentence to request a reinput is displayed or voice outputted so that the apparatus is brought into 
an input stand-by state. 

Figs. 13 and 14 are flow charts explaining the detail of a display processing routine at step S19 of Fig. 6. 

5 When the display processing at step S19 of Fig. 6 is commenced, voice input of a display instruction, 

change instruction and cancel instruction, etc. is performed at step S100 of Fig. 13. Determination whether or 
not there is information on the video recording reservation is made at step S101 . If not, an error message rep- 
resenting that there is no reservation information to be displayed is displayed and voice outputted to terminate 
the processing. If it is determined that there is information on the video recording reservation at step S101 . After 

10 the content of the video recording reservation Is displayed at step S1 03, determination whether or not there is 
information on the reservation which has not been displayed is made at step S104. If it is determined at step 
S104 that there is no reservation information which has not been displayed, the program step will proceed to 
step S113. If it is determined at step S104 that there is reservation information, whether or not the screen of 
the CRT display 30 is switched is inquired at step S105. "Yes" , "No" and "Return" by voice or instructions of 

15 change or cancel are inputted at step S106, determination whether or not the inputted voice is "Yes" is made 
at step S108. If it is determined Yes at step S108, the program step wfll proceed to step S1 15. Determination 
whether or not there is next information for the screen is made. If it is determined Yes at this step S115, the 
program step will proceed to step S1 1 6 at which next information is displayed on the screen and the program 
step will return to the step S105. If it is determined No at step S1 15, the program step will proceed to step S1 17 

20 at which an error message is displayed and will return to step S105. If the determination at step S105 is No, 
the program step will proceed to step S109. Determination whether or not the voice input is "Return" is made 
at step S109. If Yes, the program step will proceed to step S1 18. Determination whether or not previous infor- 
mation is displayed on the screen is made at the steps 118. If Yes, the previous information is displayed on 
the screen at step S119 and the program step will return to step S105. If No, the processing is terminated. If 

25 the determination at the step S109 is No, the program step S110 will proceed to step S110. Determination 
whether or not the voice input is an instruction of change is made at step S1 10. If Yes, the change processing 
is performed at step S1 20. If No, the program step will proceed to step S1 1 1 . Determination whether or not the 
voice input is an instruction of cancel is made at step S1 1 1 . If Yes, the cancel processing is performed at step 
S121 . If No, the program step will proceed to step S1 12. Determination whether or not these change and cancel 

30 processings are commenced from the instruction of display is made at step S121. If No, the program step will 
return to step S110. If Yes, the program step will proceed to step S113. Which is performed change or cancel 
is inquired at step S1 1 3 and voice "Yes", "No" and "Return" or a change instruction or cancel instruction is input- 
ted at step S114. 

If processing at step S1 14 of Fig. 13 is terminated, theprogram step will proceed to the step S125 shown , 
35 in Fig. 14. Determination whether or not voice input at step S1 14 is an instruction of change is made at the 
step S125. If Yes, the processing is terminated after performing the processing for change at step S131. If No, 
the program step will proceed to step S126. Determination whether or not the voice input at step S1 14 is a cancel 
instruction is made at the step S126. If Yes, the processing is terminated after performing the cancel processing 
at step S132. If No, the program step will proceed to step S127. Determination whether or not the voice input 
40 at step S1 27 is "Yes" is made at step S1 27. If the determination is No, the processing is terminated. If the deter- 
mination is Yes, the program step will proceed to step S128. Which is selected, change or cancel is inquired 
at the step S128 and the change instruction or cancei instruction or "Return" in voice is inputted at step S129. 
Thereafter, the program step will proceed to step S1 30. Determination whether or not the voice input is "Return" 
is made at this step. If Yes, the processing is terminated. If No, the program step will return to the step S125. 
45 Fig. 15 is a flow chart explaining the detail of the change processing routine at step S21 of the flow chart 

of Fig. 6. 

In Fig. 15, selection processing for video recording reservation is performed at step S140. Specifically, a 
schedule of the video recording reservation is displayed and a message inquiring which reservation is changed 
is displayed and voice outputted. If there are four content indicating columns in the displayed schedule, the 

50 video recording information in which column is to be changed is voice inputted, for example, first fourth at 

next step S141. Determination whether or not the actually video recording reservation information is in the col- 
umn which is specified by voice input is made at next step S142. If No at step S142, an error message is dis- 
played at step S150 and the program step will return to step S140. If Yes, the program step will proceed to 
step S143. 

55 The content to be changed of the designated video recording reserved content is inquired at step S143. 
The elementary information on the content to be changed is voice inputted at step S144. Confirmation proces- 
sing of the video recording reserved content which has been changed by the elementary information is perfor- 
med at step S145. "Yes", "No" or elementary information in voice is inputted at step S146. Determination 
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30 Determination whether or not there is a corresponding operation in the matrix is made in next step S173. 
If no, anerror message is outputted to terminate the processing at step S1 76. If Yes at step S1 73, the program 
step will proceed to step S174 in which an operation corresponding to the command is executed. Thereafter, 
a message that an operation will be executed or has been executed is outputted to terminate the processing 
at step S175. ' ^ '.•=- . by *. 

. 35 Table 1 shows an example in which to which operation mode the current operation mode' is to be shifted 
if an instruction by the voice input is outputted in the current operation mode. That is, an instruction "Power" is 
voice inputted when the current operation mode is, for example, a power off mode, the operation mode is 
brought into a power-on operation mode. If an instruction "Playback" is voice inputted when the current oper- 
ation mode is a power off, and stop mode, the operation mode is brought into "-a playback mode. If an instruction 

40 "Fast" is voice inputted when the current operation mode is, for example, stop, fast feeding, and cue modes, 
the operation mode is brought into a fast feeding mode. If the current mode is playback and pause modes, the 
operation mode is brought into the cue mode. If the current mode is rewind and review modes, the operation 
mode is brought into the review and rewind mode, respectively. If "Return" is voice inputted when the current 
operation mode is the stop, fast feeding and pause modes, the operation mode is brought into the review mode. 

45 If the current operation mode is the payback and cue modes, the operation mode is brought into the reverse 
playback mode. If the current operation mode is the rewind and review modes/ it is brought into the fast feeding 
and the review modes, respectively. In such a manner, a correct operation depending upon the current oper- 
ation mode is selected in response to the voice input "Fast" or "Return" having plural meanings. 

Fig. 18 is a flow chart explaining the detail of the idling animation processing routine at step S14 of the 

so flow chart of Fig. 6. s r:W '-: 

Determination whether or not the conversation is in the top level is made at step S181 of Fig'.- 18. -The top 
level means the level of conversation in which the basic operation of the VTR 40 is (directly) performed or the 
apparatus is brought into the above mentioned reservation/confirmation phases. If it is determined Yes (the 
conversation is in the top level) at step S181 , the idling animation image for the top level conversation is selected 

55 at step S1 86, the program step will proceed to step S1 83. If it is determined No at step S1 81 , the idling animation 
image for the processing mode in each phase is selected at step S182. It is possible to preset various idling 
animation video image for the top level and the processing mode. For example, idling action in which the ani- 
mation character AC yawns, leans on the edge of the screen, scratches himself on his own head, or lies down, 
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vo,ce synthes IZI ng means (19) for synthesizing a voice signal o?a message in response to a mes- 
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sage signal input; 

voice outputting means (20) for outputting the voice signal from the voice synthesizing means (1 9) 
in voice; and in that 

the control means (15,18) are also responsive to at least the output signal from said voice recog- 
5 nition means for outputting an action control signal for controlling the action of the animation character in 

said means and a message signal instructing a message voice which is desired to be synthesized in said 
voice synthesizing means (19). 

2. A control apparatus for electronic equipment as defined in claim 1 in which said electronic equipment (40) 
10 is a video tape recorder and the operation mode is a video recording reservation mode. 

3. A control apparatus for electronic equipment as defined in claim 2 in which if normal reserved video record- 
ing is unable due to a fact that there is an error in the item of information on the date or the item of infor- 
mation of the channel, the error item is pointed to request a reinput for bringing said video tape recorder 

15 into an input stand-by state. 

4. A control apparatus for electronic equipment as defined in claim 1, 2 or 3 in which said control means 
causes the control apparatus (15) to perform a control action in response to an input when the input has 
a content different from the currently requested input content 

20 

5. A control apparatus for electronic equipment as defined in claim 1 , 2, 3, or 4 in which said control means 
selects and outputs one control instruction appropriate for the current operation mode of said electronic 
equipment (40) among a plurality of control instructions in response to an instruction for designating the 
operation mode which is recognized by said voice recognition means (13). 

25 

6. A control apparatus for electronic equipment as defined in claim 5 in which said electronic equipment (40) 
is a video tape recorder, and if the instruction for designating the operation mode recognized by said voice 
recognition means is a word meaning "Fast" when the current operation mode of said video tape recorder 
is a "stop" or "playback" mode, said control means brings the video tape recorder into a "fast feeding" mode 

30 or "fast playback" mode, respectively. 

7. A control apparatus for electronic equipment as defined in claim 5 or 6 in which said electronic equipment 
(40) is a video tape recorder, and if the instruction for designating the operation mode recognized by said 
voice recognition means is a word meaning "Return" when the current operation mode of said video tape 

35 recorder is a "stop" or "playback" mode, said control means brings the video tape recorder into a "rewind" 

mode or "reverse playback" mode, respectively. 

8. A control apparatus for electronic equipment as defined in any one of the preceding claims in which said 
video display means (30) displays an animation character (AC), and a balloon (SP) for displaying the 

40 characters of the message. 

9. A control apparatus for electronic equipment as defined in claim 8 in which said video display means (30) 
further includes a superimposer for superimposing said animation character (AC) upon a reproduced or 
broadcast video image. 

45 

10. A control apparatus for electronic equipment as defined in any on of the preceding claims in which said 
voice inputting means (10) has a switch (12) for designating the voice input state and in which voice input 
is divided by turning the switch (1 2) on or off. 

50 
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